TheWhisper-Large-V3-Turbo is a high-performance fine-tuned version of the OpenAI Whisper Large V3 model, optimized by TheStage AI for real-time, low-latency, and low-power speech-to-text inference across multiple platforms. It supports stream transcription, word timestamps, and scalable performance, making it suitable for scenarios such as real-time subtitles, meetings, and device-side voice interfaces.

Audio ProcessingTransformersOther

TheWhisper-Large-V3 is a high-performance fine-tuned version of the OpenAI Whisper Large V3 model, optimized by TheStage AI for real-time, low-latency, and low-power consumption speech-to-text inference on multiple platforms (NVIDIA GPU and Apple Silicon).

Audio ProcessingTransformersOther

KaniTTS is a high-speed, high-fidelity Arabic text-to-speech model optimized for real-time conversational artificial intelligence applications. It adopts a two-stage pipeline architecture, combining a large language model with an efficient audio codec to achieve excellent speed and audio quality, and can meet the speech synthesis needs of multiple fields such as conversational AI, accessibility assistance, and research.

Audio ProcessingTransformersArabic

KaniTTS is a high-speed, high-fidelity text-to-speech model optimized for real-time conversational AI applications. Through a unique two-stage architecture that combines a large language model with an efficient audio codec, it achieves low-latency and high-quality speech synthesis, with a real-time factor as low as 0.2, which is 5 times faster than real-time speed.

Audio ProcessingTransformersEnglish

KaniTTS Pretrain v0.3 is a high-speed, high-fidelity text-to-speech model optimized for real-time conversational AI applications. It uses a two-stage pipeline architecture that combines a large language model and an efficient audio codec to achieve extremely low latency and high-quality speech synthesis.

Audio ProcessingTransformersMultiple Languages

The Ming-flash-omni preview version is a multimodal large model built on the Ling-Flash-2.0 sparse mixture of experts (MoE) architecture, with a total of 100B parameters and only 6B parameters activated per token. This model is a comprehensive upgrade based on Ming-Omni, showing significant improvements in multimodal understanding and generation, especially in speech recognition, image generation, and segmentation editing.

MultimodalDiffusersEnglish

MedWhisper Large ITA is a domain-adapted variant based on OpenAI Whisper Large v3 Turbo, specifically optimized for Italian medical speech recognition. This model is fine-tuned using LoRA technology on a carefully selected dataset of Italian outpatient specialty consultation recordings, significantly improving the recognition accuracy of medical terms and clinical expressions.

Audio ProcessingTransformersOther

NeuTTS Air is the world's first ultra-realistic on-device text-to-speech model with instant voice cloning capabilities. It is built on a large language model backbone with 0.5B parameters and can achieve natural speech generation, real-time performance, and speaker cloning on local devices.

Audio ProcessingGguf

MiMo Audio is an audio language model developed by Xiaomi, which demonstrates strong few-shot learning ability through large-scale pre-training. This model breaks through the limitations of traditional models that rely on fine-tuning for specific tasks and performs excellently in tasks such as speech intelligence and audio understanding, reaching an advanced level among open-source models.

Audio ProcessingSafetensors

MiMo Audio is an audio language model based on large-scale pre-training, achieving SOTA performance among open-source models in speech intelligence and audio understanding benchmark tests. This model demonstrates strong few-shot learning ability and can generalize to tasks not included in the training data, supporting various audio tasks such as speech conversion, style transfer, and speech editing.

Audio ProcessingSafetensors

Borealis is the first automatic speech recognition (ASR) audio large language model for Russian, trained on approximately 7,000 hours of Russian audio data. This model supports the recognition of punctuation marks in audio. Its architecture is inspired by Voxtral but has been improved, and it performs excellently in multiple Russian ASR benchmark tests.

Audio ProcessingPytorchOther

A speech recognition model fine-tuned on the Common Voice 17.0 Swahili dataset based on OpenAI Whisper Large v2, designed specifically for the Swahili speech recognition task of the Tanzanian children's helpline. It has a significant improvement in Swahili recognition accuracy compared to the base model.

Audio ProcessingTransformersOther

SE-DiCoW is a target speaker multi-speaker automatic speech recognition model developed jointly by BUT Speech@FIT, JHU CLSP/HLTCOE, and CMU LTI. Based on Whisper large-v3-turbo, this model significantly improves the recognition accuracy in highly overlapped multi-speaker scenarios through a self-registration mechanism and improved data augmentation techniques.

Audio ProcessingTransformersOther

An aviation traffic control speech recognition model fine-tuned based on the OpenAI Whisper Large v3 model, specifically optimized for ATC communication scenarios. It achieved a word error rate of 6.5% on the test set, significantly improving the accuracy of aviation communication transcription.

Audio ProcessingTransformersEnglish

This model is an automatic speech recognition model fine-tuned on the Egyptian Arabic dialect dataset (Egyptian-ASR-MGB-3) using the LoRA method, based on OpenAI's Whisper Large V3 model. It is specifically optimized for the recognition ability of the Egyptian Arabic dialect, significantly improving the word error rate (WER) performance on this dialect.

Audio ProcessingPeftArabic

Audio Flamingo 3 is an advanced, fully open-source large audio language model that can enhance the reasoning and understanding abilities of speech, sound, and music.

MultimodalSafetensorsEnglish

Orpheus TTS is an advanced Speech Large Language Model (Speech-LLM) based on Llama, designed to generate high-quality, emotional speech.

Audio ProcessingTransformersEnglish

Ultravox is a large multimodal speech language model capable of understanding and processing speech input, supporting multiple languages and noisy environments.

MultimodalTransformersMultiple Languages

Ultravox is a multimodal large speech language model that can process both speech and text inputs simultaneously, providing strong support for speech interaction scenarios.

MultimodalTransformersMultiple Languages

Orpheus TTS is an advanced large speech language model based on Llama, designed to achieve high-quality and emotional text-to-speech functionality.

Audio ProcessingTransformersOther